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ABSTRACT 


Objective: The monsoon year 2009 is a severe drought with 21.8% deficit rainfall from the long period average according to 
India Meteorological Department (IMD) over India since the past decade and 2010 is a normal monsoon year. Therefore, the 
verification skill of the VARSHA model has been computed for one normal monsoon and one drought year. 

Method: The statistical parameters like mean error, root mean square error and correlation coefficient has been computed at 
every model grid point and verified against the rainfall observations from India Meteorological Department and Tropical Rainfall 
Measuring Mission (TRMM). The analysis is also extended to dichotomous forecasts, i.e. yes/no forecasts, by using contingency 
tables. The four regions namely, South peninsula, Central India, North-East and North-West regions of Indian land mass have 
been considered for the verification analysis. 

Result: India receives a major portion of its annual rainfall during the summer monsoon season (June to September) and thus 
accurate prediction of summer monsoon rainfall is very crucial. Rainfall is a discrete parameter which shows large variations 
spatially as well as temporally. VARSHA, a hydrostatic global circulation model, developed at Flosolver unit, National Aerospace 
Laboratories (NAL), Bangalore, is used to predict summer monsoon rainfall from the year 2005 onwards. Forecast verification 
serves to assess the state of the art of forecasting. Therefore, verification of the model forecast is an important task for any nu¬ 
merical weather prediction centre. In this study, an attempt has been made to examine the skill of VARSHA model in predicting 
the rainfall during summer monsoon period of 2009 and 2010. 

Conclusion: The results show that model forecasts are useful at medium range and the performance of VARSHA is better in 
2010 compared to 2009. The statistical skill scores show high predictability for light rain events with a decreasing tendency with 
an increase in intensity. 
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INTRODUCTION 

Climate of Asia is dominant by the south west monsoon 
rainfall, especially over India. The Indian summer mon¬ 
soon season is one of the most spectacular manifestations 
of atmospheric circulations including regional and global 
characteristics as well as its associated connections (Mandal 
et.al., 2006). During the South-West Monsoon (also known 
as Summer Monsoon) which starts from June to September, 
India receives a major portion of its annual rainfall. The sea¬ 
sonal rainfall as a whole over India is about 89cm with 10% 
coefficient of variation (Rajeevan et.al., 2005). However, the 


contribution of rainfall due to pre-monsoon (March, April 
and May) and post-monsoon (October, November and De¬ 
cember) to the annual rainfall is about 11% (Guhathakurta 
and Rajeevan, 2008). Therefore, taking the information on 
the progress, forecasting of monsoon which is necessary to 
the farmers and other users well in advance is highly impor¬ 
tant. Realistic prediction of Indian summer monsoon rainfall 
on different space and time scales is a challenging task. Vari¬ 
ous studies on summer monsoon characteristics, modeling 
aspects, teleconnections with various global parameters, in¬ 
dices, interannual variability, intra-seasonal variability have 
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been carried out and documented (Sikka and Gadgil, 1980; 
Shukla and Mooley, 1987; Annamalai, 2001; Goswami etcil., 
2001; Gadgil, 2003; Gadgil and Gadgil, 2006; Goswamy, 
2005; Mitra et.al., 2005; Webster et al., 1998, 2006; Basu, 
2001,2005; Gadgil et ah, 2007, Rajeevan et al., 2006, 2008; 
Kelkar, 2009; Rajeevan, 2010; Janakiraman, 2011). Various 
atmospheric models with different resolutions, i.e., climate, 
global and regional models have been developed to predict 
rainfall accurately. All the studies have suggested that the 
model skills are good (Buizza, et.al., 1999; Cherubini, 2002) 
in predicting the low intensity rainfall than the high inten¬ 
sity rainfall. However, in general, mostly the models over¬ 
estimated the actually observed rainfall intensities. A small 
fluctuation in seasonal rainfall will show a large effect on the 
economy in agricultural countries like India (Rajeevan et.al. 
2004). Therefore prediction of rainfall event with intensity is 
very crucial. Verification of model forecasts is very impor¬ 
tant, because, it tells how to make the best use of the fore¬ 
casts at any weather prediction centre. Meteorologists have 
developed and devoted to forecasting verification regarding 
both verification methods and application of these methods 
in operational and experimental centres (Murphy and Daan, 
1985). A general frame work for forecast verification was 
developed by Murphy and Winkler (1987). 

VARSHA, a hydrostatic spectral Global Circulation Model 
(GCM) (Nanjundaiah and Sinha, 1999), developed at Flo- 
solver unit, National Aerospace Laboratories (NAL), Ban¬ 
galore, is used for the daily forecast of the Indian monsoon. 
The model is integrated up to 31 days ahead to forecast the 
atmosphere from the initial condition prepared using Final 
Analysis (FNL) from National Center for Environmental Pre¬ 
diction (NCEP). Later the model has integrated up to 36days 
(to implement ensembles with 5 days). VARSHA model has 
roots in National Center for Medium Range Weather Fore¬ 
casting (NCMRWF) T-80 code, later it was parallelized and 
re-engineered using new boundary layer (Rao and Narasim- 
ha, 2005) and radiation (Varghese et al, 2003) schemes by 
National Aerospace Laboratories in 1993 (Sinha et al, 1994). 
The code has a special boundary layer parameterization 
scheme for the tropics and a refined scheme for the moist 
adiabat. The spectral truncation of the model version used 
is at 120 waves in triangular truncation with 512 grid points 
in east-west and 256 grid points in north-south. The vertical 
resolution of the model is up to 18 levels in sigma coordi¬ 
nates and persisted Sea Surface Temperature (SST) is used. 
Persisted method assumes that tomorrow’s weather will be 
the same as today’s weather i.e. the conditions at the time 
of forecast will not change. The detailed model characteris¬ 
tics are explained in Table.l (Basu et.al. 2010). As a part of 
NAL-CSIR collaborations with various universities, Depart¬ 
ment of Physics, Sri Venkateswara University, Tirupati was 
selected as one of the major universities to study the char¬ 
acteristics of Monsoon through NMITLI (New Millennium 


Indian Technology Leadership Initiatives) Modeling based 
joint CSIR-NAL project on North East Monsoon prediction 
using VARSHA GCM. 

The scope of the verification is (a) to monitor forecast qual¬ 
ity over time (b) to compare the quality of different forecast 
systems i.e., to what extent does one forecast system gives 
better forecast than the other, and (c) to improve the qual¬ 
ity of the forecasts through better understanding of the fore¬ 
cast errors. Verification of VARSHA forecasts for the south 
west monsoon seasons of 2009 and 2010 was carried out in 
the present study. The years 2009 and 2010 were selected 
as 2009 is a severe drought with 21.8% deficit rainfall from 
the long period average according to India Meteorological 
Department over India since the past decade and 2010 is a 
normal monsoon year. 

DATA 

The verification analysis of VARSHA rainfall forecasts is 
done for 122 days i.e., summer monsoon season (1 st June to 
30 th September) for the years 2009 and 2010. The qualita¬ 
tive and quantitative verification has been done from 1-day 
forecast to 15-day forecast lengths. However, in the pre¬ 
sent study, the verification at different forecast lengths, i.e., 
1-day, 3-day, 5-day, 7-day, 10-day and 15-day against the ob¬ 
servations are only presented. For spatial verification Tropi¬ 
cal Rainfall Measuring Mission 3B42RT data with 0.25° x 
0.25° degree (lat x Ion) (Huffman et al 2007) are used. As 
the resolution of VARSHA forecasts is 0.7° x 0.7°, Tropi¬ 
cal Rainfall Measuring Mission data has been interpolated 
to the resolution of 0.7 degree using bilinear interpolation 
method. For temporal verification analysis in addition to the 
Tropical Rainfall Measuring Mission data, high resolution 
real time gridded rainfall data at 0.5 degree resolution from 
Indian Meteorological Department (Rajeevan et al, 2009) are 
also used. 


METHODOLOGY 

Various methods have been developed (Murphy, et.al., 1988; 
Casati, 2008; Nunny, 2003; Rajeevan, et.al., 2005; Stanski, 
et.al., 1989) to compare the distribution of forecasts against 
the observations. In this paper some important verification 
methods are used to assess the performance of VARSFLA. 
GCM for the summer monsoon seasons of 2009 and 2010. 
Towards the quantitative verification of the model, the Mean 
Error (ME), Root Mean Square Error (RMSE) and the Pear¬ 
son’s Correlation Coefficient (CC) between observations 
and forecasts at each grid point, averaged over central India 
and Indian land mass as a whole is computed. The verifica¬ 
tion scores computed are as follows: 



Int J Cur Res Rev | Vol 9 • Issue 21 • November 2017 L 






Sagaret a/.: Verification of VARSHA rainfall forecasts for summer monsoon seasons of 2009 and 2010 


Mean Error (ME) = ~H(F i — O t ) ( 1 ) 

where F. - Forecast, O - Observed. 

Root Mean Square Error (RMSE ) = ~ 0 ,) 2 (2) 

Correlation Coefficient (CC) ~ ^ ° m ^ ( 3 ) 

where F m = F; and O m = Oi 


and S, S = standard deviation of forecast and observed se- 

f, o 

ries. 

The verification analysis is also carried for dichotomous 
forecasts, i.e., yes/no forecasts. A dichotomous forecast says, 
“yes, an event will happen”, or “no, the event will not hap¬ 
pen”. The combination of forecasts (yes/no) and observa¬ 
tions (yes/no) are 

Hit - event forecast occurred and did occur 
Miss - event forecast not to occur but did occur 
False alarm - event forecast occurred but did not occur 
Correct negative - event forecast not to occur and did not 
occur 

The analysis has been carried out for various thresholds of 
rainfall intensity. An event “yes” is defined as if the rainfall 
greater than or equal to the threshold value, else it is a non 
event i.e “no”. This kind of verification is done by using the 
contingency table (Table.2). 

A perfect forecast system will produce only Hits and Correct 
Negatives, and no Miss or False Alarm. Murphy (1993) had 
suggested nine skill scores for forecast verification. Some 
of the skill scores have been computed in this report and are 
listed below. 


Bias - 


HtTS+FALSE ALARM 
HITS +M1SS 


(4) 


Range: 0 to infinity, perfect score is 1. 

It measures the ratio of forecast event frequency to the ob¬ 
served event frequency. It indicates whether the forecast 
event tends to underestimate or overestimate. 


Probability of Detection {POD) = 


HITS 

HITS+MISS 


(5) 


Range: -1/3 to 1, 0 indicate skill compared to chance, 

< 0, no skill and perfect score is 1. 

Equitable threat score is the modified skill score of threat 
score which includes the number of correct forecasts of 
events that would occur purely by random chance. Here the 
number of forecasts of the event that are correct by chance, 
i.e., Hits random, are estimated by assuming that the fore¬ 
casts are independent of observations and the forecast will 
match the observation only by chance. 


Threat Score (TS) = 


hits 

HITS +MISS+FALSE ALARM 


( 8 ) 


Range: 0 to 1, 0 indicates no skill, perfect score is 1. 


It measures the fraction of observed and/or forecast events 
that were predicted correctly. This score is also called as 
critical success index. The threat score has an advantage of 
not being affected by the correct negative events i.e., no-rain 
events. Unlike the probability of detection and False Alarm 
Ratio, it is sensitive to both false alanns and missed events 
and is therefore a more balanced score. The perfect score of 
threat score indicates that all observed events are perfectly 
forecasted. 


False Alarm Ration (FAR) = 


FALSE ALARM 
HITS+FALSE ALARM (9) 


Range: 0 to 1, perfect score is 0. 


It gives the measure of forecast events that were observed 
to non events. It is sensitive to false predictions but ignores 
misses. This score can always be increased by under fore¬ 
casting the number of sever events, but only at the cost of 
more missed events which are not seen by the score. 


The rainfall variation over the entire country is not homo¬ 
geneous. Therefore the country was classified into four geo¬ 
graphical sub regions by India Meteorological Department 
i.e., North-West India, North-East India, Central India and 
South Peninsular India as shown in Fig.l. The verification is 
carried out for rainfall at every grid point over India, rainfall 
averaged over the Indian land mass, over South Peninsula 
(area marked by green colour). Central India (area marked 
by blue colour), North-East India (area marked by orange 
colour) and North-West India (area marked by red color). 


RESULTS 


Range: 0 to 1, perfect score is 1. 

It measures the probability of an observed event that is suc- 
cesslully forecasted by the model. It is also called as hit rate. 


Equitable Threat Score ( ETS ) = 


HITS-HIT S random 


HITS +MISS + FALSE ALARM -HITSrandom 


( 6 ) 


where HITS r 


_ (HITS+MISS')(H1TS+FALSE ALARM ) 


TOTAL EVENTS 


(7) 


Spatial verification of VARSHA rainfall forecasts of various 
forecast lengths, i.e., 1-day, 3-day, 5-day, 7-day, 10-day and 
15-day has been done against the observations from Tropi¬ 
cal Rainfall Measuring Mission for the years of 2009 and 
2010. During the year 2009, most of the subdivisions are in 
deficient condition. The All India Average Rainfall (AIAR) 
for the summer monsoon season is 23% lesser than from 
its normal which is comparable to the most severe drought 
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(24% in 1972) in the last 100 years and for June it was 48% 
which is recorded as the lowest rainfall since 1871 (Fran¬ 
cis and Gadgil, 2009). Even though monsoon arrived early 
over India in 2009 on 23 rd May, the country experienced 
severe drought. Immediately after the declaration of onset 
over Kerala, a severe cyclonic storm had formed over Bay 
of Bengal which helped to get an advance of monsoon over 
Indian states; later the monsoon never gained its normal po¬ 
sition. Droughts in India are mainly associated with El-Nino 
events. The El-Nino phase of the southern oscillation has a 
direct impact on India which leads to weak or enhanced sum¬ 
mer monsoon. 

The comparison of VARSHA forecast of all India average 
rainfall with India Meteorological Department observation 
for the summer monsoon seasons of 2009 (left panel) and 
2010 (right panel) is shown in Fig.2. The first panel indicates 
for June, second, third and fourth panels indicate July, Au¬ 
gust and September months respectively. From the Figure, 
the observed All India Average Rainfall (blue bars) during 
the summer monsoon months is below normal (red line) for 
2009. The VARSHA forecast of All India Average Rainfall 
is well projected the deficiency of rainfall in all monsoon 
months. However, in the normal monsoon year of 2010, the 
observed All India Average Rainfall during June July August 
September is just above the normal where as VARSHA fore¬ 
cast for 2010 depicts the All India Average Rainfall is just 
below normal. Therefore, the severe drought in 2009 was 
reasonably well predicted by VARSHA model, in particular, 
VARSHA model does not over predict the rainfall (Sinha, 
2010). The normal monsoon year is also predicted with less 
magnitude. 

During the monsoon season of 2009, the onset over Kerala is 
on 23 rd May which is 8 days earlier to the normal onset date 
i.e. 1 st June. However, in 2010, the onset over Kerala is on 
31 st May. The forecast of monsoon onset over Kerala is also 
attempted well in advance every year using VARSHA GCM 
with a specified criterion as mentioned below. 

A Continuous increase of Kinetic Energy with a minimum of 
25 J/Kg at 600hPa in the box A (Fig.3). 

Mean zonal wind at 600hPa in a box A should be positive 

An average rainfall of more than 5 mm for 3 consecutive 
days in box B(Fig.3) 

Then the I s * day is declared as monsoon onset date with a 
model error of ±3 days. 

With the above criterion, the VARSHA GCM had predicted 
the monsoon onset over Kerala accurately for the both years 
2009 (Karuna Sagar and Mrudula, 2010) and 2010 (Fig.3). 

Fig.4 shows the spatial distribution of mean error for the 
summer monsoon season of 2009 with different length of 
day forecasts. The upper panel represents 1-day, 3-day and 


5-day forecast lengths and lower panel indicates 7-day, 10- 
day and 15-day forecast lengths. The error has been calcu¬ 
lated by subtracting the observed rainfall from the forecast 
quantity. The figure depicts that there are large differences 
between observed and model forecasts of rainfall. The posi¬ 
tive errors can be seen over south-west peninsula region and 
are increasing with forecast lengths in particular over the 
Arabian Sea and southern Bay of Bengal region. Another 
patch of positive error is noticed over foothills of Himalayas. 

Fig.5 depicts the mean error for the summer monsoon season 
of the normal year 2010. Form the figure, it can be seen that 
the model overestimates rainfall over the southern peninsula 
and foot hills of Himalayas and also the magnitude of the 
error is increasing with forecast length over these regions. 
However, a strong positive error can be noticed over most of 
the Indian landmass except southern peninsula. Since model 
forecasts are good over Indian land mass during 2009, it de¬ 
picts that VARSHA GCM well predicted the drought rainfall 
whereas, in good monsoon period (2010), the model shows 
excess in both positive and negative side. However, the 
above described mean error showing the seasonal mean error 
may not be fully informative, because the errors of opposite 
signs may get cancelled or added due to the summing up for 
the entire season. Hence, root mean square error values for 
the above mentioned regions have been calculated. 

Spatial root mean square errors estimated and are shown 
in Fig.6 (2009) and Fig.7 (2010). These figures depict that 
magnitude of root mean square error is more along the south 
west coast, over Bay of Bengal and the Himalayan region 
which may be attributed to the topography/orography effect 
or due to the model physics. Root mean square error over 
these specified regions is more for 3-day forecast than that 
of 1-day forecast and 5-day forecast. Beyond this forecast 
length the root mean square error values are seen increas¬ 
ing. Higher values of root mean square error are found over 
Ocean region than land region and its magnitude is oscil¬ 
lating around a threshold with forecast length. Over central 
India, the magnitude of Root mean square error values are 
quite less and over southern land mass it is more. A similar 
kind of pattern in Root mean square error is seen in 2010 
with an extendable area over Central India. The magnitude 
of Root mean square error is increasing with forecast day 
length for both 2009 and 2010 over Indian Ocean. Efforts 
are needed to improve the physics in the model which plays 
a major role in rainfall prediction. 

Analysis of Pearson’s correlation coefficient (Fig.8) shows 
that model predictions were well correlated with the ob¬ 
servations up to 5 days in 2009 and further the correlation 
coefficient is weakening and become negative. For the year 
2010 (Fig.9), the model predictions are in phase with the 
observations up to 3-day forecasts and partially with 5-day 
forecasts. From the 5-day forecast length, the predictions are 
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out of phase for most of the regions. However, in both the 
years, higher values of correlation coefficient can be seen 
over ocean than in Indian land mass. The spatial variation of 
correlation coefficient from region to region is large in 2009 
for 1-day forecast, whereas in 2010, the spatial variation of 
correlation coefficient is less. The above three statistics re¬ 
veals that the model forecasts have better skill in predicting 
the monsoon rainfall in 2009 than in 2010. 

Temporal verification of all India average rainfall is also car¬ 
ried out for the years 2009 and 2010. The skill scores like 
mean error, root mean square error and correlation coeffi¬ 
cient has been computed for the entire Indian land mass as a 
whole (Table.2) and over a box spanning from 20°N - 25°N 
and 75°E - 85°E (Table.3). The observations from both India 
Meteorological Department and Tropical Rainfall Measuring 
Mission are used for this analysis. From Table.2, the mean 
error over Indian land mass is negative for all the forecast 
lengths which indicate that the model forecasts of rainfall 
intensity are comparatively less than the observations from 
both India Meteorological Department and Tropical Rainfall 
Measuring Mission. However, the observed rainfall from 
Tropical Rainfall Measuring Mission is more than the gauge 
rainfall (India Meteorological Department). Therefore, the 
magnitude of root mean square error is smaller when fore¬ 
casts are compared with India Meteorological Department 
than with Tropical Rainfall Measuring Mission. This is due 
to the unpredictable behaviour of the model over Ocean re¬ 
gion. Whereas, the Root mean square error is seen increasing 
with forecast length for both 2009 and 2010. Highest value 
of correlation coefficient (0.91 and 0.81 with India Mete¬ 
orological Department, 0.8 and 0.71 with Tropical Rainfall 
Measuring Mission) are found in 1-day forecasts. Therefore 
1-day forecasts are in phase with the observations and have 
a decreasing tendency with the length of forecast. But the 
forecasts are significant up to 10-day forecasts for All India 
Rainfall over the above regions. Similar kind of phase is re¬ 
flected when verification is carried out over central India. 
The VARSHA forecasts are very close in magnitude and in 
phase with India Meteorological Department observations 
than Tropical Rainfall Measuring Mission for different fore¬ 
casts lengths. 

For the verification of dichotomous forecasts, a contingency 
table is prepared to compare with Tropical Rainfall Meas¬ 
uring Mission observations. Various skill scores have been 
computed with various thresholds for different lengths of 
forecasts. The analysis is carried out at every grid point and 
over four selected regions by considering the threshold value 
from 5mm to 50mm/day. Fig.10 shows the Bias scores for 
the years 2009 (left panel) and 2010 (right panel) which in¬ 
cludes rainfall averaged over Indian land mass (upper first 
panel) and second, third and fourth panel indicates other four 
selected geographical regions i.e., n-west India, n-east In¬ 
dia, central India and south India respectively. Bias score for 


all India average rainfall is high at lower threshold of rain¬ 
fall and varying between 0.5-1.0 for higher threshold with 
different day forecasts. The Bias skill score has a decreas¬ 
ing tendency as length of day forecast increases, but has a 
slight variation in magnitude with the increase in the rainfall 
threshold value. From the figure, it can be seen that the mag¬ 
nitude of bias is small over the selected geographical regions 
than India as whole, except over southern India. The model 
forecasts are much closer to the observations when the num¬ 
ber of grid points taken for the average is increasing. The 
model tendency to overestimate an event is less for light rain 
cases and increasing with forecast length. But the magnitude 
of Bias over south peninsula is more than 1 and increasing 
with the threshold, which suggests that the model forecasts 
are overestimated over the south Indian region. 

Fig. 11 shows the verification of skill score probability of de¬ 
tection for the above two years over India as a whole and 
the four geographical regions. Probability of detection is 
noticed to be consistently very high for all forecast lengths 
with threshold value 5mm to 20mm. But over the North West 
Indian region, the magnitude of probability of detection is 
less when compared to the other regions especially in 2009. 
The magnitude of probability of detection decreases with in¬ 
crease in the threshold amount of rainfall in all the regions 
in both the years. High value of probability of detection in¬ 
dicates that model can forecast majority of the observed yes/ 
no rainfall events. Thus, it can be concluded that light rain 
events are correctly predicted by the model for all forecast 
day lengths. The minimum probability of detection can be 
seen in North West Indian region at the higher threshold 
rainfall value. Over the remaining specified domains, the 
minimum value of probability of detection is more than 0.2 
which tells that model skills are considerable for higher rain¬ 
fall threshold also, probability of detection has an increas¬ 
ing trend from individual grid points to all India verifica¬ 
tion. The behaviour of the equitable threat score for 2009 and 
2010 is presented in Fig.12. Highest magnitude of equitable 
threat score is obtained when all India average is considered 
and it is seen to be less and varying between 0 and 1.5 when 
individual grid points are considered. From the verification, 
it can be seen that the spread between the equitable threat 
score values of different day forecasts is increasing from grid 
point to all India average. The spread is more while consider¬ 
ing the thresholds between 20mm and 40mm with both in¬ 
clusive. The lowest value of equitable threat score indicates 
that the percentage of model forecasts for ‘no’ events is high. 

The performance of threat score skill is shown in Fig.13. The 
threat score value with rainfall average over Indian landmass 
is above 0.9 for 2009 and 0.95 for 2010. The value of threat 
score is reducing with the increase in the number of grid 
points considered for averaging. From the figure, the magni¬ 
tude of threat score is noted to decrease with the increase of 
rainfall threshold and the length of forecast. Highest threat 
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score value at low rainfall threshold indicates that the less 
rainfall events were correctly diagnosed. 

The False Alarm Ratio, which ignores misses and sensitive 
to the false alarm, has been calculated for the summer mon¬ 
soon season of 2009 and 2010 and summarized in Fig. 14. It 
depicts that the value of False Alarm Ratio is increasing with 
the increase of rainfall threshold and forecast length, where 
as False Alarm Ratio is decreasing with the increase of num¬ 
ber of grid points considered for averaging. The temporal 
variation of different skill scores at each grid point over the 
Indian land mass by using different thresholds of rainfall for 
the years of 2009 and 2010 is shown in Table.5. The magni¬ 
tude of all skill scores for the year 2009 is more than 2010, 
which depicts that at every grid point the model forecasts are 
captured the true events in 2009 than in 2010. 

DISCUSSION 

Francis and Gadgil (2009) reported that a drought was not 
predicted by the leading centres in the world using the com¬ 
plex models of the coupled atmosphere system. However, 
the models had predicted above average rainfall for June, 
July and August. The forecasts of VARSHA suggest that 
the all India average rainfall for June is below the long-term 
mean (Sinha, 2010). It also predicted a 51% of deficiency for 
June. VARSHA predicted well the drought rainfall whereas, 
in 2010, the model shows excess. The increase in the mag¬ 
nitude of the root mean square error over Indian Ocean is 
noticed in both 2009 and 2010. The analysis suggests that 
the forecasts are much closure with India Meteorological 
Department than Tropical Rainfall Measuring Mission. The 
spread between the equitable threat score value is increasing 
from grid point to all India average. The false alarm is also 
more in the forecast and increasing with forecast length. 

CONCLUSIONS 

Statistical verification of the performance of VARSHA 
rainfall forecasts with observations using different forecast 
lengths has been carried out for summer monsoon seasons 
of2009 and2010. The VARSHA rainfall forecasts are nearer 
to the observations and the skill is better for rainfall aver¬ 
aged over the entire Indian landmass than at each individual 
grid point. The prediction skill is more in 2009 i.e., for the 
severe drought year than normal monsoon year i.e., in 2010. 
The skill is seen decreasing with the increase of the rainfall 
threshold value and forecast length. The model forecasts are 
over estimated over the south peninsula region and foot hills 
of Himalayas. However, the under estimation of rainfall is 
noticed over the most of the Indian land region and north¬ 
ern Bay of Bengal. The magnitude of the error is increasing 
with the forecast lengths as it was well known. The model 


forecasts are in phase with the observations up to 5 to 7-day 
forecast lengths. The VARSHA forecasts of rainfall are much 
closer to the India Meteorological Department observations 
than Tropical Rainfall Measuring Mission over oceanic re¬ 
gions. Similarly, a good prediction skill of VARSHA is no¬ 
ticed for the low frequency rainfall. This study shows that 
VARSHA forecasts can be usefi.il in medium range forecast¬ 
ing especially over the country as a whole. Its forecast skills 
are very useful to the farmers and the Government to make 
the seasonal analysis. 
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Table i: Characteristics of the VARSHA weather forecast model 

Dynamics 


Spectral resolution 
Transform grid 

Vertical co-ordinate 


120 waves in triangular truncation 
512 equally spaced points in the east-west 
256 Gaussian grid points in the north-south 
18 sigma levels ( 0 . 995 , 0 . 981 , 0 . 96 , 0 . 92 , 0 . 856 , 

0 . 777 , 0 . 688 , 0 . 594 , 0 . 497 , 0 . 425 , 0 . 375 , 0 . 325 , 0 . 275 , 0 . 225 , 0 . 175 , 0 . 124 , 0 . 074 , 
0 . 021 ) 


Vertical differencing scheme 
Time integration scheme 
Integration time step 
Physics 


Arakawa ( 1984 a,b) vertical finite differencing scheme 
Leap frog scheme 
7.5 minutes 
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Radiation 

Lacis and Hansen ( 1974 ) short wave and Fels-Schwarzkoff s GFDL long wave for¬ 
mulation. 

Shallow convection 

Tiedtke's formulation ( 1983 ) 

Deep convection 

Kuo-Anthes ( 1975 ) scheme 

Grid scale condensation 

Kessler ( 1969 ) 

PBL parameterization 

New scheme based on the scaling arguments of Rao and Narasimha ( 2006 ) 

Land surface process 

3 layer soil model for soil temperature and bucket hydrology of Manabe ( 1969 ) for 
soil moisture prediction. 

Air-sea Interaction 

Roughness length over sea computed by Charnock's 
(t 955 ) relation. 

Gravity wave drag parameterization 

Surface boundary data 

Lindzen ( 1981 ) and Pierrehumbert ( 1987 ) formulation 

Orography 

Consistent with NCEP's FNL data 

Sea Surface Temperature(SST) 

Actual SST from NCEP's FNL analysis for the first day and anomaly added to clima 
tology for subsequent days 

Soil moisture 

Climatological 

Deep soil temperature 

Climatological 

Albedo 

Climatological 

Surface roughness 

Climatological 

Cloud cover 

Climatological 

Snow cover 

Climatological 

Sea ice 

Computer resources 

Climatological 

Computer 

Flosolver Mark 8 with Intel Xeon Quad core processors 

Operating System 

Red Hat Enterprise Linux. 

Computational performance 

About 10 minutes computation time on 4 processors 
for 1 day integration. 


Table 2: Temporal verification of all India average rainfall for the years 2009 and 2010 

Forecast Year 

length 

2009 2010 

Mean Error RMSE CC Mean Error RMSE CC 



IMD 

TRMM 

IMD 

TRMM 

IMD 

TRMM 

IMD 

TRMM 

IMD 

TRMM 

IMD 

TRMM 

l-day 

- 0.06 

- 0.38 

151 

2.22 

O. 9 I 

0.8 

- 1.29 

- 2.03 

2.38 

3-55 

0.81 

0.71 

3-day 

0.93 

0.61 

2.61 

2.86 

0.81 

0.74 

0.28 

- 0.45 

3.03 

3.86 

0.61 

0.5 

5-day 

- 0.03 

- 0.35 

2.83 

3.18 

0.68 

0.61 

- 0.13 

- 0.86 

3.61 

4-37 

0.44 

0.37 

7-day 

- 0.81 

-1.12 

3i5 

3-53 

0.61 

0.52 

- 1.41 

- 2.13 

3-41 

4.36 

0.54 

0.48 

10-day 

- 1.25 

-i-57 

3.78 

4.04 

0.48 

0.43 

- 1.97 

- 2.69 

4.08 

4.72 

0.43 

0.47 

15-day 

-l.Ol 

- 1.32 

4-34 

4.42 

0.31 

0.33 

-1.6l 

- 2.34 

4.07 

4.78 

0.32 

0.34 
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Table 3: Temporal verification of average rainfall over central India (20N - 25 N, 75L' - 85E) for the years 2009 and 2010. 


Forecast 

length 

Error 

IMD TRMM 

2009 

RMSE 

IMD TRMM 

IMD 

Year 

CC Error 

TRMM IMD TRMM 

2010 

RMSE 

IMD TRMM 

IMD 

CC 

TRMM 

l-day 

-0.39 

-1.56 

4.88 

6.22 

0.81 

0.76 

-1-51 

-5.07 

5 i 9 

10.11 

0.73 

0.52 

3-day 

-0.49 

-1.68 

6.56 

8.16 

0.61 

0.55 

-0.92 

-4.48 

6.14 

10.34 

0.51 

O.4I 

5-day 

-0.87 

-2.07 

8.62 

10.39 

0.36 

0.28 

-0.33 

-3.88 

7 - 5 i 

11.41 

0.39 

0.26 

7-day 

-1.59 

-2.79 

8.72 

IO.9I 

0.32 

0.19 

-i -33 

-4.88 

7-35 

11.12 

0.38 

0.32 

10-day 

-1.46 

-2.66 

9.08 

10.89 

0.24 

0.18 

-2.01 

-5.56 

7.01 

11.16 

O.4I 

0.35 

15-day 

" 2-55 

- 3-74 

9.72 

11.6 

0.03 

-O.Ol 

-2.74 

-6.23 

8.11 

I2.4I 

0.19 

0.16 


Table 4: General structure of the contingency table 

Forecast 

Contingency table 

Observed 

Yes 

No 

Total 

yes 

Hits 

False alarm 

Forecast yes 

no 

Misses 

Correct negative 

Forecast no 

Total 

Observed yes 

Observed no 

Total 


Table 5: Temporal variation of skill scores 
and 2010 

(verification at each grid point) over Indian land mass for the years 0/2009 



5 

IO 

15 

2009 

(threshold) 

20 23 30 

35 

40 

50 

5 

10 

15 

2010 

(threshold) 

20 25 30 

35 

40 

50 

1 day 

Bias 

0.98 

0.97 

0.96 

0.96 

0.95 

0.95 

O.94 

0.93 

0.93 

0.85 

0.83 

0.81 

0.80 

0.79 

0.78 

0.77 

0.76 

0.75 


POD 

0.56 

0.50 

0.47 

0.44 

0.42 

0.39 

O.38 

0.36 

0.35 

0.55 

0.49 

0.44 

0.41 

0.39 

0.37 

0.35 

0.33 

0.31 


ETS 

0.14 

0.13 

0.13 

0.13 

0.12 

0.12 

0.12 

0.12 

0.12 

o.n 

o.n 

0.10 

0.10 

0.10 

0.10 

0.10 

0.09 

0.09 


TS 

0.39 

0.34 

0.31 

0.29 

0.27 

0.25 

O.24 

0.23 

0.22 

0.42 

0.36 

0.32 

0.30 

0.28 

0.26 

0.24 

0.23 

0.22 


FAR 

0.43 

0.47 

0.51 

0.53 

0.55 

0.58 

O.59 

0.61 

0.62 

0.35 

0.40 

0.44 

0.47 

0.50 

0.52 

0.54 

0.56 

0.57 

3 day 

Bias 

0.95 

0.95 

0.96 

0.97 

0.97 

0.98 

O.98 

0.98 

0.99 

0.89 

0.88 

0.88 

0.88 

0.88 

0.88 

0.88 

0.88 

0.89 


POD 

0.51 

0.45 

0.42 

0.39 

0.36 

0.34 

O.32 

0.31 

0.29 

0.55 

0.49 

0.45 

0.42 

0.39 

0.37 

0.35 

0.33 

0.31 


ETS 

0.09 

0.09 

0.08 

0.08 

0.07 

0.07 

0.07 

0.07 

0.06 

0.09 

0.08 

0.08 

0.07 

0.07 

0.07 

0.06 

0.06 

0.06 


TS 

0.35 

0.30 

0.27 

0.24 

0.22 

0.21 

O.I9 

0.18 

0.17 

0.41 

0.35 

0.31 

0.29 

0.26 

0.24 

0.22 

0.21 

0.20 


EAR 

0.46 

0.52 

0.56 

0.59 

0.62 

0.64 

0.66 

0.68 

0.69 

0.38 

0.44 

0.48 

0.52 

0.55 

0.57 

0.60 

0.62 

0.64 

5 day 

Bias 

0.96 

0.89 

0.90 

0.90 

0.90 

0.91 

0.91 

0.91 

0.92 

0.85 

0.84 

0.84 

0.84 

0.84 

0.84 

0.84 

0.84 

0.84 


POD 

0.46 

0.40 

0.37 

0.34 

0.31 

0.29 

0.37 

0.25 

0.24 

0.51 

0.45 

0.41 

0.38 

0.35 

0.32 

0.30 

0.28 

0.27 


ETS 

0.07 

0.06 

0.05 

0.05 

0.04 

0.04 

0.04 

0.04 

0.04 

0.07 

0.06 

0.05 

0.05 

0.04 

0.04 

0.04 

0.04 

0.03 


TS 

0.32 

0.27 

0.24 

0.21 

0.19 

0.18 

0.16 

0.15 

0.14 

0.38 

0.32 

0.29 

0.26 

0.23 

0.21 

0.19 

0.18 

0.17 


EAR 

0.48 

0.54 

0.58 

0.62 

0.65 

0.67 

0.70 

0.71 

0.73 

0.39 

0.45 

0.50 

0.54 

0.58 

0.61 

0.63 

0.65 

0.67 
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7 day 

Bias 

0.84 

0.84 

0.85 

0.85 

0.85 

0.86 

0.86 

0.85 

0.85 

0.77 

0.76 

0.75 

0.74 

0.74 

0.74 

0.73 

0.73 

O.72 


POD 

0.42 

0.37 

0.33 

0.30 

0.27 

0.26 

O.23 

0.22 

0.20 

0.46 

0.41 

0.37 

0.34 

0.31 

O.29 

0.26 

O.25 

O.23 


ETS 

0.06 

O.O5 

O.O4 

0.04 

0.03 

0.03 

0.03 

0.02 

0.02 

0.06 

0.05 

0.05 

0.04 

O.O4 

O.O4 

0.03 

0.03 

0.03 


TS 

0.30 

O.25 

0.22 

0.19 

0.17 

0.16 

O.I4 

0.13 

0.12 

0.35 

0.30 

0.26 

0.24 

0.21 

0.20 

0.18 

0.17 

0.15 


FAR 

0.49 

0.55 

0.60 

0.64 

0.67 

0.69 

O.72 

0.73 

0.75 

0.39 

0.45 

0.50 

0.54 

0.57 

0.60 

0.63 

0.65 

0.67 

10 day 

Bias 

0.79 

0.78 

0.78 

0.77 

0.77 

0.77 

0.77 

0.77 

0.77 

0.68 

0.65 

0.64 

0.63 

0.63 

0.62 

0.62 

0.62 

0.61 


POD 

0.38 

0.33 

O.29 

0.26 

0.24 

0.22 

0.20 

O.I9 

0.18 

0.41 

0.35 

0.31 

0.29 

O.27 

O.25 

O.23 

0.21 

0.20 


ETS 

0.04 

O.O3 

0.03 

0.02 

0.02 

0.02 

0.02 

0.02 

0.02 

0.05 

0.05 

0.04 

0.04 

O.O4 

O.O4 

0.03 

0.03 

0.03 


TS 

0.27 

0.22 

0.19 

0.17 

0.15 

O.I4 

0.13 

0.12 

0.11 

0.32 

0.27 

0.24 

0.21 

0.19 

0.18 

0.16 

0.15 

O.I4 


FAR 

O.5O 

0.57 

0.62 

0.65 

0.68 

O.7O 

0.73 

0.74 

0.76 

0.39 

0.45 

O.5O 

0.53 

0.56 

0.59 

0.62 

0.64 

0.66 

15 day 

Bias 

0.74 

0.74 

0.74 

0.74 

0.75 

0.75 

0.76 

0.76 

0.76 

0.70 

0.68 

0.68 

0.67 

0.67 

0.67 

0.67 

0.67 

0.67 


POD 

0.34 

O.29 

0.26 

O.23 

0.22 

0.20 

0.18 

0.17 

0.16 

0.41 

0.36 

0.32 

O.29 

O.27 

O.25 

O.23 

0.21 

0.20 


ETS 

0.02 

0.02 

0.01 

0.01 

0.01 

0.01 

0.01 

0.01 

0.01 

0.04 

0.04 

0.03 

0.03 

0.03 

0.02 

0.02 

0.02 

0.02 


TS 

O.24 

0.20 

0.17 

0.15 

O.I4 

0.13 

0.12 

0.11 

0.10 

0.31 

0.27 

0.23 

0.21 

O.I9 

0.17 

0.16 

0.15 

O.I4 


FAR 

0.53 

0.60 

0.64 

0.68 

O.7O 

0.73 

0.75 

0.76 

0.78 

0.41 

0.47 

0.52 

0.56 

0.59 

0.62 

0.65 

0.67 

0.69 



Figure 1: Different selected regions over India considered for 
the study. Left panel shows India as a whole and right panel 
shows. 
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Figure 2: All India average of Rainfall for the summer mon¬ 
soon seasons of 2009 (left panel) and 2010 (right panel). 
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Figure 4: Average error of rainfall for summer monsoon season 
of 2009. Panels indicate (from left) 1-day, 3-day, 5-day(upper), 
7-day, 10-day and 15-day(lower) forecasts respectively. 



Figure 5: Average error of rainfall for summer monsoon season 
of 2010. Panels indicate (from left) 1-day, 3-day, 5-day(upper), 
7-day, 10-day and 15-day(lower) forecasts respectively. 



Figure 6 : RMSE of rainfall for summer monsoon season of 
2009. Panels indicate (from left) 1-day, 3-day, 5-day(upper), 
7-day, 10-day and 15-day(lower) forecasts respectively. 



Figure 7: RMSE of rainfall for summer monsoon season of 
2010. Panels indicate (from left) 1-day, 3-day, 5-day(upper), 
7-day, 10-day and 15-day(lower) forecasts respectively. 



Figure 8: Correlation Coefficient of rainfall for summer mon¬ 
soon season of 2009. Panels indicate (from left) 1-day, 3-day, 
5-day(upper), 7-day, 10-day and 15-day(lower) forecasts re¬ 
spectively. 
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0.7 

0.6 

0.4 

0.3 



ntm/day 


Figure 9: Correlation Coefficient of rainfall for summer mon¬ 
soon season of 2010. Panels indicate (from left) 1-day, 3-day, 
5-day(upper), 7-day, 10-day and 15-day(lower) forecasts re¬ 
spectively. 
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Thrcshold(mm/day) 

Figure 11: Variation of skill score POD for 2009 and 2010 with 
all India average (first panel), over n-west India (second pan¬ 
el), n-east India (third panel), central India (fourth panel) and 
south India (fifth panel). 


Threshold (mm/day) 

Figure 10: Variation of skill score Bias for 2009 and 2010 with 
all India average (first panel), over n-west India (second pan¬ 
el), n-east India (third panel), central India (fourth panel) and 
south India (fifth panel). 
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Figure 12: Variation of skill score ETS for 2009 and 2010 with 
all India average (first panel), over n-west India (second pan¬ 
el), n-east India (third panel), central India (fourth panel) and 
south India (fifth panel). 
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Sagaret a/.: Verification of VARSHA rainfall forecasts for summer monsoon seasons of 2009 and 2010 
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Figure 13: Variation of skill score TS for 2009 and 2010 with all 
India average (first panel), over n-west India (second panel), 
n-east India (third panel), central India (fourth panel) and south 
India (fifth panel). 
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Figure 14: Variation of skill score FAR for 2009 and 2010 with 
all India average (first panel), over n-west India (second pan¬ 
el), n-east lndia(third panel), central lndia(fourth panel) and 
south lndia(fifth panel). 
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